Skip to content

ci: add automated GCP sandbox integration test workflow triggered daily and on releases#143

Merged
yiyche merged 1 commit into
mainfrom
feature/gcp-integration-test-workflow
Jul 10, 2026
Merged

ci: add automated GCP sandbox integration test workflow triggered daily and on releases#143
yiyche merged 1 commit into
mainfrom
feature/gcp-integration-test-workflow

Conversation

@yiyche

@yiyche yiyche commented Jun 23, 2026 •
edited
Loading

Copy link
Copy Markdown
Member
  • Daily Cron Trigger (gcp_integration_test.yaml): Runs every day at 02:00 UTC, executing tests against the :latest pre-built container images (datacommons-services:latest, datacommons-ingestion-helper:latest, and datacommons-data:latest) to catch daily integration regressions on head. **we are not auto releasing, running this for a while to test if this gets flaky before auto-drafting release`
  • Release Quality Gate (auto_draft_release.yaml): Refactors the Auto-Draft Release workflow to enforce that the E2E GCP sandbox integration test passes successfully before the GitHub draft release and tag (e.g. v1.1.1) are created. If the test fails, the workflow fails, preventing version tagging of buggy code.
  • Manual Trigger (workflow_dispatch): Allows manual execution from the GitHub Actions UI with an optional version tag input override (defaults to latest).
  • WIF Authentication: Authenticates securely to the GCP sandbox environment using Workload Identity Federation (WIF) and service account impersonation.

@gemini-code-assist

gemini-code-assist Bot commented Jun 23, 2026

Copy link
Copy Markdown
Contributor

Note

Gemini is unable to generate a review for this pull request due to the file types involved not being currently supported.

@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch 5 times, most recently from df45270 to 06efafc Compare June 24, 2026 22:47
@yiyche yiyche marked this pull request as ready for review June 24, 2026 22:57
@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch from 06efafc to 5dd8ad3 Compare June 24, 2026 23:00
@yiyche yiyche requested a review from dwnoble June 24, 2026 23:01
@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch from 5dd8ad3 to 82f7a9a Compare June 24, 2026 23:02
dwnoble
dwnoble approved these changes Jun 30, 2026
View reviewed changes
Comment thread tests/datacommons-integration-tests/README.md Outdated
Pulls the latest templates, provisions a completely new isolated sandbox stack in GCP via Terraform (Spanner DB, GCS bucket, Cloud Workflows, and Cloud Run service), performs ingestion, runs the tests, and destroys the sandbox on completion (unless `--keep-sandbox` is specified).
* **Usage:**
```bash
python3 tests/datacommons-integration-tests/gcp_test_runner.py \

@dwnoble dwnoble Jun 24, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use uv to run these so the dependencies are pulled automatically

@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch 3 times, most recently from bb4672a to 4a4ba57 Compare July 10, 2026 23:24
@yiyche
feat: add GCP integration test workflow and modernize test runner
581b7fc 
- Adds automated daily GCP sandbox E2E test workflow (gcp_integration_test.yaml)
- Simplifies integration test script (gcp_test_runner.py) using --dcp-version
- Modularizes pytest suites and adds OECD Wages test coverage
- Restricts test schedule to Mon-Thu
- Gates release workflow (auto_draft_release.yaml) with tests
@yiyche yiyche force-pushed the feature/gcp-integration-test-workflow branch from 4a4ba57 to 581b7fc Compare July 10, 2026 23:27
@yiyche yiyche added this pull request to the merge queue Jul 10, 2026
Merged via the queue into main with commit a4f847c Jul 10, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dwnoble dwnoble dwnoble approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@yiyche @dwnoble